Interpretable machine learning with an ensemble of gradient boosting machines

نویسندگان

چکیده

A method for the local and global interpretation of a black-box model on basis well-known generalized additive models is proposed. It can be viewed as an extension or modification algorithm using neural model. The based ensemble gradient boosting machines (GBMs) such that each GBM learned single feature produces shape function feature. composed weighted sum separate GBMs resulting functions which form are built in parallel randomized decision trees depth 1, provide very simple architecture. Weights well features computed iteration by Lasso then updated means specific smoothing procedure. In contrast to model, provides weights explicit form, it simply trained. lot numerical experiments with implementing proposed synthetic real datasets demonstrate its efficiency properties interpretation.

برای دانلود رایگان متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Gradient boosting machines, a tutorial

Gradient boosting machines are a family of powerful machine-learning techniques that have shown considerable success in a wide range of practical applications. They are highly customizable to the particular needs of the application, like being learned with respect to different loss functions. This article gives a tutorial introduction into the methodology of gradient boosting methods with a str...

متن کامل

Learning Non-linear Features for Machine Translation Using Gradient Boosting Machines

In this paper we show how to automatically induce non-linear features for machine translation. The new features are selected to approximately maximize a BLEU-related objective and decompose on the level of local phrases, which guarantees that the asymptotic complexity of machine translation decoding does not increase. We achieve this by applying gradient boosting machines (Friedman, 2000) to le...

متن کامل

Using Machine Learning Gradient Boosting to model commercial activities

As urban population grow, commercial activities play a fundamental role in providing goods, services and are part of cities fabric. Policy makers and urban planners need new tools to study these areas. This paper describes how machine learning can be applied to predict the density of commercial activities in cities. A supervised machine learning method called Gradient Boosting was applied to a ...

متن کامل

Making machine learning models interpretable

Data of different levels of complexity and of ever growing diversity of characteristics are the raw materials that machine learning practitioners try to model using their wide palette of methods and tools. The obtained models are meant to be a synthetic representation of the available, observed data that captures some of their intrinsic regularities or patterns. Therefore, the use of machine le...

متن کامل

Hypertension Prediction in Primary School Students Using an Ensemble Machine Learning Method

Introduction: The prevalence of hypertension in children is increasing, and this complication is considered the most important risk factor for cardiovascular diseases in older age. Early detection and control of hypertension can prevent its progress and reduce its consequences. Machine learning methods can help predict this complication promptly and reduce cost and time. This study aimed to pro...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

ژورنال

عنوان ژورنال: Knowledge Based Systems

سال: 2021

ISSN: ['1872-7409', '0950-7051']

DOI: https://doi.org/10.1016/j.knosys.2021.106993